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Dual pairs of generalized Lyapunov inequalities 
and balanced truncation of stochastic linear systems 

Peter Benner, Tobias Damm, and Yolanda Rocio Rodriguez Cruz 


Abstract —We consider two approaches to balanced trunca¬ 
tion of stochastic linear systems, which follow from different 
generalizations of the reachability Gramian of deterministic 
systems. Both preserve mean-square asymptotic stability, but 
only the second leads to a stochastic H°°- type bound for the 
approximation error of the truncated system. 

Index Terms —generalized Lyapunov equation, model order re¬ 
duction, balanced truncation, stochastic linear system, asymptotic 
mean square stability 
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Introduction 

Optimization and (feedback) control of dynamical systems 
is often computationally infeasible for high dimensional plant 
models. Therefore, one tries to reduce the order of the system, 
so that the input-output mapping is still computable with 
sufficient accuracy, but at considerably smaller cost than 
for the original system, |T), (2J, Q, J?), Q. To guarantee 
the desired accuracy, computable error bounds are required. 
Moreover, system properties which are relevant in the context 
of control system design like asymptotic stability need to be 
preserved. It has long been known that for linear time-invariant 
(LTI) systems the method of balanced truncation preserves 
asymptotic stability and provides an error bound for the L 2 - 
induced input-output norm, that is the H ' 30 -norm of the asso¬ 
ciated transfer function, see ED, 0. When considering model 
order reduction of more general system classes, it is natural to 
try to extend this approach. This has been worked out for 
descriptor systems in m, for time-varying systems in 0, 
|[T0l . fTTl . for bilinear systems in fl2l . ifTTl , iTRl and general 
nonlinear systems e.g. in G3J. Yet another generaliztion of 
LTI systems is obtained considering dynamics driven by noise 
processes. This leads to the class of stochastic systems, which 
have been considered in a system theoretic context e.g. in 
ED, D3, (ED. Quite recently, balanced truncation has also 
been described for linear stochastic systems of Ito type in m, 
HD, HD- Already the formulation of the method leads to two 
different variants that are equivalent in the deterministic case, 
but not so for stochastic systems. It is natural to ask which 
of the above mentioned properties of balanced truncation also 
hold for these variants. The aim of this paper is to answer this 
question. 
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Let us first recapitulate balanced truncation for linear deter¬ 
ministic control systems of the form 

x = Ax + Bu, y = Cx, cr(A) C C_ . (1) 

Here A G R nxn , B G M nxm , C G R pxn , and x(t) G K n , 
y(t) G R p and u(t) G R m are the state, output, and input of 
the system, respectively. Moreover cr(A) denotes the spectrum 
of A and C_ the open left half complex plane. Let 

C A : X \-a A T X + XA 

denote the Lyapunov operator and 

C* A : X AX + XA T 

its adjoint with respect to the Frobenius inner product. Then 
cr(A) C C_ if and only if there exists a positive definite 
solution X of the Lyapunov inequality C A (X) < 0, by 
Lyapunov’s classical stability theorem, see e.g. El- 

Balanced truncation means truncating a balanced realiza¬ 
tion. This realization is obtained by a state space transforma¬ 
tion computed from the Gramians P and Q, which solve the 
dual pair of Lyapunov equations 

C a {Q) = A T Q + QA = -C T C , (2a) 

C* A {P) = AP + PA r =-BB T , (2b) 

or more generally the inequalities 

C a (Q) < ~C T C , C* A {P) < -BB t . (3) 

These (in)equalities are essential in the characterization of 
stability, controllability and observability of system (0. If 
det P/ 0, the inequalities 0 can be written as 

Ca(Q) < ~C T C , (4a) 

C^P- 1 ) = P~ X A + A T P ~ 1 < -P- 1 BB T P~ 1 . (4b) 

In the present paper we discuss extensions of ([3]) and 0 
for stochastic linear systems. 

As indicated above, the equivalent formulations 0 and 
0 lead to different generalizations, if we consider Ito-type 
stochastic systems of the form 

dx = Ax dt + Nx dw + Bu dt, y = Cx , (5) 

where A,B,C are as in 0 and N G R raxn . System 0 is 
asymptotically mean-square stable (e.g. If22ll . 1231 , SUD), if 
and only if there exists a positive definite solution X of the 
generalized Lyapunov inequality 

{C A + Hn){X) = A T X + XA + N t XN < 0 . 
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Here U N : X ^ N T XN and H* N : X NXN T . This 
stability criterion indicates that in the stochastic context the 
generalized Lyapunov operator Ca + H.v takes over the role 
of C A - Substituting Ca by Ca + CVn in ([3]) and ([4]), we obtain 
two different dual pairs of generalized Lyapunov inequalities. 
We call them type I: 

c C A + n n ){Q) = A t Q + QA + N T QN < -C T C , (6a) 
(C A + n N )*(P) =AP + PA t + NPN t < ~BB T , (6b) 

and type II: 

(Ca + IIjv)(Q) = A T Q + QA + N T QN 

< -C T C , (7a) 

(C A + U N )(P~ 1 ) = ATp - 1 + P~ X A + N t P~ 1 N 

< -P- 1 BB T P~ 1 . (7b) 


To simplify the notation, we only consider the case k = 1 
and set w = wi, N = Ni. But all results can immediately be 
generalized for k > 1. 

Let L 2 w (R + ,W) denote the corresponding space of non¬ 
anticipating stochastic processes v with values in W 1 and norm 

IKOIlij, : = £ IkWII 2 ^ < 

where £ denotes expectation. 

Let the homogeneous equation dx = Ax dt + Nxdw be 
asymptotically mean-square-stable, i.e. £ (||a;(f)|| 2 ) t C£f 0, for 
all solutions x. 

Then, by Theorem |A. 1 1 the equations 

A t Q + QA + N t QN = - C T C , 

AP + PA t + NPN t = -BB t , 


Note that ([6]) corresponds to ([3} in the sense that C* A (P) has 
been replaced by (Ca + IIjy)*(P), while 0 corresponds to 
<0 where Ca(P 1 ) has been replaced by (Ca + IIjv)(P 1 ). 
In general (if N and P do not commute), the inequalities ( |6b| ) 
and ( |7b| ) are not equivalent. At first glance it is not clear which 
generalization is more appropriate. 

If the system is asymptotically mean-square stable and 
certain observability and reachability conditions are fulfilled, 
then for both types there are solutions Q,P > 0. By a suitable 
state space-transformation, it is possible to balance the system 
such that Q = P = C > Ois diagonal. Consequently, the usual 
procedure of balanced truncation can be applied to reduce the 
order of 0. For simplicity, let us refer to this as type I or 
type II balanced truncation. 

Under natural assumptions, this reduction preserves mean- 
square asymptotic stability. For type I, this nontrivial fact has 
been proven in 1241 . Moreover, in l20l . an // 2 -error bound has 
been provided. However, different from the deterministic case, 
there is no H 00 -type error bound in terms of the truncated 


entries in S. This will be shown in Example 1.3 

In contrast, for type II, an H 30 -type error bound has been 
obtained in in. In the present paper, as one of our main 
contributions, we show in Theorem II.2 that type II balanced 
truncation also preserves mean-square asymptotic stability. 
The proof differs significantly from the one given for type 
I. Using this result, we are able to give a more compact proof 
of the error bound. Theorem II.4 which exploits the stochastic 
bounded real lemma 03. 

We illustrate our results by analytical and numerical exam¬ 
ples in Section IV. 


have unique solutions Q > 0 and P > 0. Under suitable 
observability and controllability conditions, Q and P are 
nonsingular. 

A similarity transformation 

(A, N, B, C) (S'" 1 AS, S _1 iVS, S _1 H, CS) 
of the system implies the contragredient transformation as 

(Q,P) (S t QS,S~ 1 PS~ t ) . 

Choosing e.g. S = LUS _1//2 , with Cholesky factorizations 
LL t = P , R T R = Q and a singular value decomposition 
RL = UT.V T . we obtain S _1 = S _1 / 2 C/ T R and 

S t QS = S- 1 PS" t = S = diag(<Ti,...,(7 n ) . 

After suitable partitioning 

v riA o 

[ 0 s 2 

a truncated system is given in the form 

(An,Nn,Bi,Ci) = (riASr.TiJVSr.TiB.CSr) . 

The following result has been proven in ll24l . 

Theorem 1.1 Let A,N € R” x " satisfy 

a (I ®A + A(g)/ + ./V(g)iV)cC_. 

For a block-diagonal matrix E = diag(Ei,E 2 ) > 0 with 
er(Ei) n ct(E 2 ) = 0, assume that 

A t E + EA + N t CN < 0 and AE + EA T + NT,N t < 0. 


, S = [ Sr S 2 ] 


s- J = 


T\ 

T 2 


I. Type I balanced truncation 
Consider a stochastic linear control system of Ito-type 

k 

dx = Ax dt + ^ Njx dwj + Bu dt, y = Cx , (8) 

j =i 

where Wj = (wj(t))teu + are uncorrelated zero mean real 
Wiener processes on a probability space (Cl, T, p) with respect 
to an increasing family (J r i ) te r + of c-algebras JF t C T 
(e.g. ED, ED). 


Then, with the usual partitioning of A and N, we have 

<j(I 0 An + An 0 I + N\\ 0 Ah) C C_ . 

Its implication for mean-square stability of the truncated 
system is immediate. 

Corollary 1.2 Consider an asymptotically mean square stable 
stochastic linear system 

dx = Ax dt + Nx dw . 
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Assume that a matrix £ = diag(£i,£ 2 ) is given as in 
Theorem 1.1 and A and N are partitioned accordingly. 

Then the truncated system 


II. Type II balanced truncation 
We now consider the inequalities |7]). 


dx r = AnX r dt + N\iX r dw 
is also asymptotically mean square stable. 

If the diagonal entries of E 2 are small, it is expected that 
the truncation error is small. In fact this is supported by an 
H 2 -error bound obtained in GOl . Additionally, however, from 
the deterministic situation (see a, Ei), one would also hope 
for an H 00 -type error bound of the form 

? 

\\y — 2 /r|Uj,(R + ,B»>) < a(traceE 2 )|M|L 2 ; (R +j Rm) (9) 

with some number a > 0. The following example shows that 
no such general a exists. 


Example 1.3 Let A = — 


1 0 
0 a 2 


with a > 1, N = 


0 0 
1 0 


, B = 


’C=[ 0 1]. 


Solving a with equality, we get P = 


4 ^ 0 

0 2cA 


0 4^ J 


, Q = 


with a(PQ) = {g^g^r} so that £ = 

1 Tl- 

y/S a 2 ' 

2 a 2 0 

0 1/2 


1 1 

diag(or, 02 ), where or = and cr 2 = The system 

T 2 a 2 0 11 ^ 4 

is balanced by the transformation S = 


Then CS = ^74 [ 0 1 ] so that C r = 0 for the truncated 

system of order 1. Thus the output of the reduced system is 
y r = 0, and the truncation error ||L — L r || is equal to the 
stochastic H °°-norm (see 03) of the original system. 


Lemma II. 1 Assume that dx = Axdt + Nxdw is asymp¬ 
totically mean-square-stable. Then inequality © is solvable 
with P > 0. 


Proof: By Theorem A.l for a given Y < 0, there exists a 
P > 0 , so that A T P^+ P~ X A + ^P^N = Y. Then 
P = e~ 1 P, for sufficiently small e > 0, satisfies 


A T P ~ 1 + P _1 A + N T P~ 1 N = eY < -£ 2 p- l BB T P~ l 


so that © holds even in the strict form. □ 

It is easy to see that like in the previous section a state space 
transformation 


(A, N, B, C ) 1 —y (S '” 1 AS, S^NS, S^B, CS) 


leads to a contragredient transformation Q i-a S T QS , P i-A 
S~ 1 PS~ T of the solutions. That is, Q and P satisfy © 
and fTb} , if and only if S T QS and S 1 PS 1 do so for the 
transformed data. As before, we can assume the system to be 
balanced with 


Q = P = E = diag(< 7 i/,..., cr„ I) 



( 11 ) 


where o\ > ... > cr v > 0 and cr(Ei) = {or,..., oy}, 
er(£ 2 ) = {ctv + i, ..., er„}. Hence, we will now assume (after 
balancing) that a diagonal matrix E as in ( fTT| is given which 
satisfies 


INI = sup \\y\\ Ll . 

x( 0 )= 0 ,||«|| i 2 ) =l 


We show now that this norm is equal to -p- = 2aer 2 . 

V2 a 

Thus, depending on a, the ratio of the truncation error and 
trace E 2 = cr 2 can be arbitrarily large. 

According to the stochastic bounded real lemma. Theorem 
is the infimum over all 7 so that the Riccati inequality 


A.5 


0 < A t X+ XA +N t XN-C T C - ^XBB t X (10) 


-2a;i + x 3 - Xx\ -(a 2 + l)x 2 - ^2X1X2 
— {a 2 + l)x 2 — 73X1X2 —2a 2 X3 — ^x 2 — 1 


possesses a solution X 


X[ x 2 
x 2 x 3 


< 0 . 


If a given matrix X satisfies this condition, then so does 
the same matrix with x 2 replaced by 0. Hence we can assume 
that x 2 = 0 , and end up with the two conditions £3 < — Aj 
and (after multiplying the upper left entry with —y 2 ) 

0 > x\ + 27 2 xi - y 2 x 3 = (x\ + 7 2 ) 2 - 7 2 (7 2 + x 3 ) 
>N + 7 2 ) 2 - 7 2 (7 2 - 2^)- 


Thus necessarily 7 2 > Aj, Le. 7 > yA. This already proves 
that ||L|| > = 2 acr 2 , which suffices to disprove the 

existence of a general bound a in (|9). Taking infima, it is 
easy to show that indeed ||L|| = ^A. 


A t E + £A + N t T,N < —C T C , (12a) 

A r E " 1 + E _1 A + N t T,~ 1 N < —T,~ 1 BB t Y~ 1 . (12b) 


Partitioning A, N, B , C like E, we write the system as 

dx 1 = (AnXi + Ai 2 x 2 ) dt + (NnXi + Ni 2 x 2 ) dw + B 3 u dt 
dx 2 = (A 2 ia;i + A 22 a: 2 ) dt + (N 2 \X\ + N 22 x 2 ) dw + B 2 u dt 
y = C\Xi + C 2 x 2 . 

The reduced system obtained by truncation is 

dx r = Anx r + Nux r dw + B\udt , y r = C\x r . 

The index r is the number of different singular values 07 
that have been kept in the reduced system. In the following 
subsections, we consider matrices 

An Ai 2 
N 2 1 N 22 ’ 

E = diag(Ei, £ 2 ) as in ( fTT| , and equations of the form 

A r E + £A + N t YN = -C T C (13a) 
A t E _1 + E _1 A + N t Y~ 1 N = —BB t (13b) 

with arbitrary right-hand sides —C T C < 0 and —BB T < 0. 


A = 


An Ai 2 

A 2 i A 22 


N = 
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For convenience, we write out the blocks of these equations 
explicitly: 

-An + Eij4h + -/Vj^Ei./Vii 

= -iV 2 T 1 E 2 iV 21 -C 1 T (7 1 (14) 


Taking the scalar product of the equation ( [T4| with V, we 
obtain 0 > atrace(EiV) whence a = 0 and C\V = 0, 
N 2 \V = 0 by Corollary |A.4| Hence 

(Hf 1 E 1 + E 1 H 11 + 7V 1 T 1 E 1 iV 11 )F = 0. (24) 


Af 2 Ei + E 2 A 2 i + iV^ExiVn 

= -JV&E 2 JV 2 i -C%Cx (15) 

4f 2 E 2 + E 2 A 22 + -ZV^E 2 1V 22 

= -Nf 2 ^N V 2 - Cj C 2 (16) 

Ah Zf 1 + E^Au + TV^E^TVn 

= -Nh^Nn - B ± Bl (17) 

1 + E 2 1 H 21 + TV-^E-i^ 1 iVn 

= -NhZ^Nii - B 2 Bl (18) 

a£e 2 1 + e 2 1 h 22 + nJ 2 E 2 1 N 2 2 

= -N&E^Nu - B 2 Bl (19) 

A. Preservation of asymptotic stability 

The following theorem is the main new result of this paper. 


Analogously, we have BjV = 0 by CD- 
In particular, from A' 2 | V = 0, we get 


(A + n^) 


v o ]\ 
0 0 \) 


Auk + VAh + N n VNh VAh + N n VNh 
An V + NnVNh N 2 i VNh 

0 VAh ' 

a 21 v o' 


We will show that A 2 \V = 0, which implies 


0£o(I®A + A®I + N®N) (25) 

in contradiction to ( |20| , and thus finishes the proof. 

We first show that Im V is invariant under An and Nn- 
To this end let Vz = 0. Then by ( [23] ), 

0 = z T (A n V + VAh + N n VNh) z = z T N n VNhz , 


Theorem II.2 Let A and N be given such that 

a {I <g> A + A iS> I + N g> N) c C_ . (20) 

Assume further that for a block-diagonal matrix E = 
diag(Ei, E 2 ) > 0 with er(Ei) (T cr(E 2 ) = 0, we have 

A T E + EA + W T EiV < 0 and (21a) 
A T E _1 + E -1 A + iV :r E- 1 Ar < 0 . (21b) 

Then, with the usual partitioning of A and N, we have 

rr(/ 0 An 4- An ® f 4 Wn 0 lVn) c C_ . (22) 


whence also VN^z = 0, i.e. N^z £ KerV. From this, we 
have 

0 = (AnV + VA T X1 + N n VNh) z = VAf t z , 

implying Ah z £ Ker V. Thus Ah Ker V C Ker V and 
Aft Ker V C Ker V. 

Since KerV = (Imk) 1 , it follows further that Imk is 
invariant under An and Nn. 

Let V = Vi V-f, where V\ has full column rank, i.e. 
det V I T V, f 0. Then by the invariance, there exist square 
matrices X and Y, such that 


Again we have an immediate interpretation in terms of mean- 
square stability of the truncated system. 

Corollary II.3 Consider an asymptotically mean square sta¬ 
ble stochastic linear system 

dx = Ax dt + Nx dw . 

Assume that a matrix E = diag(Ei,E 2 ) is given as in 
Theorem |//.2| and A and N are partitioned accordingly. 

Then the truncated system 

dx r = AnX r dt + NnX r dw 

is also asymptotically mean square stable. 


An Vi = VX and N n Vi = Vi Y . 

It follows that 

0 = A n ViVi T + ViV? Ah + N lx ViV?Nh 
= V^X + X T + YY t )V? , 

whence X + X T + YY T = 0. Moreover, from we get 

Ah iSiVi = -EiAnVi - A^EiiVnVi 

= -E 1 V 1 X - W^EiViK . (26) 

Using this substitution in the following computation, we obtain 


Proof of Theorem |II.2[ Note that the inequalities ( |2T[ are 
equivalent to the equations ( [14] ) - ( | 1 9[ > with appropriate right- 
hand sides —C T C and —BLr. 


By way of contradiction, we assume that ( [22] ) does not hold. 
Then by Theorem A.3 there exist V>0, Vy^O, a>0 such 
that 


0 > Vi T E? (A^Er 1 + Ei" 1 An + IVfiE^iVu) E?Vi 

= Vi T Si(Af’iEiVi) + (AfiEiVi) T E?Vi 

+ V?Y 2 1 Nh'Zf 1 Nn'Z 2 1 V 1 

= - Vi T E? ViX - X T V, T E?Vi (27) 

- Vi T E?ATi T iEiViF - Y T V±Y,\NnY‘\V\ 

+ V?Y\NhYf 1 Nn'ZlVi . 


A n V + VAh + NnVNh = aV . 


(23) 
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We will show that the right hand side has nonnegative trace. 
This then implies that the whole term vanishes. Note that 

trac e{Y T V^'X 3 1 V 1 Y) = tracers? Vi YY T ) 

= trace(-y 1 T Sfyi(X + X T )) 

= trace(-y 1 T Sfy 1 X - X T V^'X\V 1 ) . 


Taking the trace in ( |27} , we have 

0 > trace (y t V?Y%V^Y - V?'T%N? 1 E 1 V 1 Y 
- Y T V?Y 1 N 11 Y 2 1 V 1 + 


= trace 

where 

M = 


V{Y 

Vi 


i T 


M 


E? 


V{Y 

V! 


-ErJVuEf 
-EfiN^Ei E 


The matrix M is positive semidefinite, because the upper 
left block is positive definite, and the corresponding Schur 
complement 


- E^AftEiE^EiiViiE^ = 0 


— 3<s 


Applying this identity repeatedly, we get 

A 2:L £f Vi = XfA 2 iVi for all k € N. 

If fi is the minimal polynomial of £f, then er(£i)n<T(£ 2 ) = 0 
implies det /r(E|) 7 ^ 0 and 

0 = A 21 niY\)V 1 = n{Xl)A 21 Vi , 

whence A 2 iVi = 0 and also A 2 iH = 0. Hence we obtain the 
contradiction (|25|. □ 


B. Error estimate 

The following theorem has been proven in m using 
LMI-techniques. Exploiting the stability result in the previous 
subsection, we can give a slightly more compact proof based 
on the stochastic bounded real lemma. Theorem |A. 6 | 

Theorem II.4 Let A and N satisfy 

o(I (g> A + A <g> I + N ® N) C C_ . 


vanishes. Hence 


E? -EiAT n E? 


' ViY ' 

_ -EfiVfiEi EfA^Ei^nE? 


Vi 


implying via the first block row that NnXfV\ = E^ViF. 
From {27}. using also ( [26} again, we thus have 

0 = (A^Ef 1 + Sr'An + A^E^iVn) Efc 
= -EiVi-X - - + E^AuEfVi + N^-JAV^Y 

= -E 1 H 1 X + E^AuEfVi , 

i.e. AnEfVi = EfViX. It follows that for arbitrary k £ N, 
the eigenvector V in ([23} can be replaced by 

Ef VEf = Ef V{V?X\ k 

because 

0 = E?Hr (X + X T + YY T ) V? E? 

= A n (EfVitf’E?) + (E^VfE?) Af, 

+ N n (Yi\V\Vi Ef) Wn - 

Induction leads to 

0 = An (£?*Vikf’Ef) + (Ef ViH^Ef) A?i 
+ N ll [XfV 1 V^Xl k )Nl 1 . 

As above, we conclude that A r 21 Ef fc Vi = 0, CiSf k Vi = 0, 
and BfY,1 k Vi = 0. Multiplying ( [15} with E^ fc-1 ^Vi and ( [18} 
with Ei fc Hi, we get 

Af 2 Sf-Vi + E 2 A 2 iEi (fc ” 1 Vi + iV^Ef-ViF = 0 , 
A^Ef-Vi + E^ 1 A 2 iEfVi + iV^Ef"ViE = 0 . 
Hence (after multiplication with £ 2 ), for all k > 1, we have 

E^iE^^Vi = -E 2 (A^Sf-Vi + A^Ef-^y) 

= A 2 iE? fc Vi . 


Assume furthermore that for E = diag(£i,E 2 ) > 0 with 
E 2 = diag(<j r _)_i/,..., a^I) and cr(Ei) IT ct(£ 2 ) = 0, the 
following Lyapunov inequalities hold, 

A t E + EA + N t YN < -C T C , 

A t E- 1 + E _1 A + A^E^AI < -Yr 1 BB T Yr 1 . 

If x( 0) = 0 and 2v(0) = 0, then for all T > 0, it holds that 

II y — VtWlI, ([0,T]) < 2(cr r+ i + . . . + (J l/ )||u|| i 2 ([o,T]) ■ 

Proof: We adapt a proof for deterministic systems e.g. (2| 
Theorem 7.9]. In the central argument we treat the case where 
E 2 = cr v I and show that 

\\y — 2 / 1/-1 ||l 2 [o,t] < 2 (7 J/ ||ti|| i 2 [ 0iT ] . (28) 

From ( [14} and ( [17} , we can see that also 

A^Ei + EiAn + AlnEiWn < —Cf C\ , 

AyE] -1 + E^ 1 A 11 + < -E^ 1 B 1 Bj'Yf 1 . 

Hence we can repeat the above argument to remove 
..., oy-i-i successively. By the triangle inequality we 
find that 

1/-1 

\\V - Vrhl [0,T] < ll%+! “ yjhl[0,T] 

j=r 

< 2(ov + . . . + cr r+ i)||u|| i 2 j [ 0j T] ■ 

which then concludes the proof. 

To prove ( [28} , we make use of the stochastic bounded real 
lemma. In the following let r = u — 1 and consider the error 
system defined by 

dx e = A e x e dt + N e x e dw + B e u dt , 

Ve = C e x e = y - y r , 
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where 



Xl 




4 -n 

A12 

0 

x e = 

X 2 

j A e 

= 


421 

A22 

0 


x r 




0 

0 

1 


' Nn 

X12 

0 




' B x 

N e = 

n 21 

N 22 

0 


J 

B e = 

b 2 


0 

0 

1 

£ 



B n 


c e = [ Ci C 2 - C ! ] . 


Applying the state space transformation 


X\ 


1 

H 

1 

H 

■i 

_1 


■ I r 

0 

-It ' 


Xl 

x 2 

= 

x 2 

= 

0 

In—r 

0 


X 2 

x r 


X\ + x r 


Ir 

0 

Ir 


X r 


Zs->" 


we obtain the transformed system 




' An 

A12 

0 

A e 

= S-'AeS = 

5A21 

A22 

5A21 



0 

A12 

An 



Nn 

N \ 2 

0 

N e 

= S-'NeS = 

\N 2 1 

X22 

\N 2 i 



0 

X12 

Nn 


0 





B e = S~ 1 B 


B 2 

2 £?i 


C e = C e S = [ Cl C 2 0 ] 


By Theorem A.6 we have 
inequality 


IPU 


< 2 cr„, if the Riccati 


satisfies 
we have 


. Partitioning 1 Z ai/ (X) = 


in: 

\T ■ 


In' 

tT \ 


Rn 

Rl 1 

^? 3 T l ' 

-R21 

R22 

Rl 

-R31 

R32 

R33 

-N* 
2 21 

N 2 i 

+ Cl Cl 

Nl[Y 2 

JV21 

+ C*Ci 


- y^ 2 T 1^21 


i?2i — A 12 Ei + cr^A 2 i + N 12 YiNu + ovA^A^i + C2 Ci 
ifct = y^iVat 

f?22 = 2 ctj/(A^2 + A 22 + N2 2 N 22 ) + A^EiAY 


T - Y-^12^1 1 AA2 T- C2 C 2 + B0.B2 

\T v 1 1 v /I 1 j\ 7 'T’ v Ar 1 A tT ^ 


— A 22 E2 + E2 A 2 2 + X 22 E 2 X 2 2 + 7 V 12 £i-/Vi 2 + C 2 C 2 
+ ct^(A^ 2 S 2 1 + E 2 ^22 + A^E 2 1 A^22 
+ A^E^AY + ^BiBlY ^ 1 ) 

-R32 = ^(Si 1 Ai2 + A^E-l 1 A^i2) + a v (A2i + N21N22) 

+ u v E^ 

= ^(E^Aia + JV^Ei^ia + A^E 2 
+ E^ 1 B 1 S 2 t E^ 1 ) 

i?33 = ^K 1 Er 1 + Er 1 An ■ ^-t 
+ alY^ 1 B 1 B^ 1 


nSr^tU 


A^E^A^ 


'7V 2 T iiV2i 


= cr^A^Ei + E^Mn + A^E^AY 

+ Ej-^rBfEj- 1 + A^E^A^) - ^ 2^21 


0 I 
I 0 


With the permutation matrix J = 

M = J(A t E" 1 + E" 1 A + N t Y ~ x N 


we define 


Y~ 1 BB 1 Y~ 1 )J , 

where M < 0 by ( | 13 b[ >. Using ( p~ 4 ] ) - ( fT 9 | ), we have 

K*AX) = 


A T E + EA + N t YN + C T C 0 


Y 

2 


^ 2 T l 

0 

-^21 


^ 2 T l 

0 

-Nl 


0 

T 


0 


+ C„ 


' 0 

0 

0 

M 


< 0 , 


which is inequality 


□ 


(X) = Al X + XA e + NjXN e + Cj C e 


4 al 


XB e Bi X < 0 


( 29 ) 


Example II.5 Let the system (A, N, B. C ) and Q be as in 
Example |I. 3 | The matrix 


i + yr^ 0 

0 p 


> 0 , where 0 < p < 1 , 


possesses a solution X > 0 . We will show now that the block- 
diagonal matrix 


satisfies inequality ( | 7 b| >. As in Example |I. 3 | we have L r = 0 
for the corresponding reduced system of order 1, so that the 
truncation error again is independently of p G }0 .1], 

On the other hand we have 


X = diag(Ei, 2 E 2 ,CT^E 1 x ) = diag(Ei, 2 ovJ,o^E 1 : ) > 0 


erf = min a{PQ) 


1 1 

4 a 2 (1 + y/T^pj ~ 8a 2 ’ 
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with equality for p —> 0. Theorem |II.4| thus gives the sharp 
error bound 2 a 2 = - jyy- Note, that there is no P > 0 
satisfying the equation ( |7b| >. 

The previous example illustrates the problem of optimizing 
over all solutions of inequality fTb}. 


shows. It can easily be verified that the type I Lyapunov 
equations © are solved by 


Q = 


6 3 
3 3 


and P = 


3 3 
3 6 


The type II inequalities (|7]i are e.g. solved by 


III. Numerical Examples 


Q = 


6 3 
3 3 


and P = 


8 0 
0 12 


To compare the reduction methods we need to compute 
Q , P from (|6| or ([TJ. Instead of the inequalities ( [6a] ), ( |6b| ), ( |7a| ) 
we can consider the corresponding equations, for which quite 
efficient algorithms have been developed recently, e.g. EZ), 
ED, m, ED. These also allow for a low-rank approximation 
of the solutions. In contrast we cannot replace f7b| ) by the 
corresponding equation, because this may not be solvable (see 
Example |II.5| >. Even worse, we do not have any solvability or 
uniqueness criteria nor reliable algorithms. 

Therefore, in general, we have to work with the inequality 
m which is solvable according to Lemma |lLT| but of course 
not uniquely solvable. 

In view of our application, we aim at a solution P of < | 7 h [ > , 
so that (some of) the eigenvalues of PQ are particularly small, 
since they provide the error bound. Choosing a matrix Y < 0 


and a very small e along the lines of the proof of Lemma II. 1 
can be contrary to this aim. Hence some optimization over all 
solutions of ( [7b] ) is required. 

Note also that a matrix P > 0 satisfies if and only if 
it satisfies the linear matrix inequality (LMI) 


PA T + AP - 
NP 


BB 1 


PN t 

-P 


< 0 . 


(30) 


Thus, LMI optimal solution techniques are applicable. How¬ 
ever, their complexity will be prohibitive for large-scale prob¬ 
lems. Therefore further research for alternative methods to 
solve ( |7b| adequately is required. 

By L and L,., we always denote the original and the r- 
th order approximated system. The stochastic fT°°-type norm 
||L —L r || is computed by a binary search of the infimum of all 
7 such that the Riccati inequality ( fT0| > is solvable. The latter is 
solved via a Newton iteration as in lITSl . Finally, the Lyapunov 
equations 0 are solved by preconditioned Krylov subspace 
methods described in ED- 

Unfortunately, for small 7, i.e. for small approximation er¬ 
rors, this method of computing the error runs into numerical 
problems, because ( fTO] ) contains the term 7 -2 . This apparently 
leads to cancellation phenomena in the Newton iteration, if e.g. 
7 < 10 -7 . Therefore we mainly concentrate on cases where 
the error is larger, that is we make r sufficiently small. 


A. Type II can be better than type I 

In many examples we observe that type II reduction gives 
a valid error bound, but the approximation error still is better 
with type I. This, however, is not always true, as the example 


Reduction to order r = 1 gives the following error bounds 
and approximation errors for both types: 



02 

IIL-M 

I 

2.4853 

3.9647 

II 

6.9282 

3.5614 


As we see, the type I approximation error is larger than both 
the truncated singular value and the type II approximation 
error. 


B. An electrical ladder network with perturbed inductance 

As our first example with a physical background, we take up 
the electrical ladder network described in ED, consisting of 
n /2 sections with a capacitor C, inductor L and two resistors 
R and R as depicted here. 



But following e.g. (32), we assume that the inductance L is 
subject to stochastic perturbations. For simplicity, we replace 
the inverse L -1 formally by L -1 + w in all sections. Here 
L = 0.1 and w is white noise of a certain intensity a, where 
we set (j = l. E.g. for n = 6, we have the system matrices 


A = 


N = 


-1 

CR 

y 

L 

0 

0 

0 

0 

0 

1 

0 

0 

0 

0 


-1 

c _ 

-RR 

l(r+r) 

R 

c(r+r) 

0 

0 

0 


0 

-RR 
R-\-R 

0 

0 

0 

0 


0 

-R 

R-\-R 

0 

1 

0 

0 


0 

-R 

i(fl+R) 

-1 

c(r+r) 

y 

L 

0 

0 

0 

0 

0 

-RR 

R+R 

0 


0 


0 

0 

-1 

c 

-RR 

l(r+r) 

R 

c(r+r) 

0 


0 

0 

0 

-R 

R-\-R 

0 

1 

T 


0 
0 

0 

l(r+r) 0 
-1 -1 
c(r+r) c 


0 

0 

0 

— R 


0 

0 

0 

0 

0 

—R 


B ={ ck 0 0 0 0 0 0 1 
c =[ -T 0 0 0 0 0 0]. 


—R 
t J 


(A, N, B, C T ) 


-1 1 
0 -1 


0 0 
1 0 


0 

3 


3 \ For larger n, the band structure of A and N is extended 

0 J periodically. To see the behaviour of our two methods, we 























































reduce from order n = 20 to the orders r = 1, 3, 5,..., 19, 
and compute both the theoretical bounds and the actual ap¬ 
proximation errors in the H°°- norm. The results are shown in 
the following figure. 



In this example, for both types the bounds hold, and for all 
reduced orders, type I gives a better approximation than type 


II. 


matrices N £ 

' l 
l 
l 


u 


( . A heat transfer problem 

As another example we consider a stochastic modification of 
the heat transfer problem described in lfl4l . On the unit square 
O = [0, l] 2 the heat equation Xt = Ax is given with Dirichlet 
condition x = Uj, j = 1, 2, 3 on three of the boundary edges 
and a stochastic Robin condition n-Xx = (l/2 + w)x on the 
fourth edge (where w stands for white noise). A standard 5- 
point finite difference discretization on a 10 x 10 grid leads to 
a modified Poisson matrix A £ jjiooxioo anc j corresponding 
10x100 and B £ R 100x3 . We use the input 
and choose the average temperature as the output, 
i.e. C = y^o[lj ■••>!]• We apply balanced truncation of type I 
and type II. For type II, an LMI-solver (MATLAB® function 
mincx) is used to compute P as a solution of the LMI ( |30| ) 
which minimizes trace P or trace PQ. 

In the following two figures, we compare the reduced 
systems of order r = 20 for both types. The left figure 
shows the decay of the singular values. Since the LMI-solver 
was called with tolerance level 10 -9 , only the first about 25 
singular values for type II have the correct order of magnitude. 
The right figure shows the approximation error \\y(t) —y r (t) || 
over a given time interval. For both types it has the same order 
of magnitude. In fact, for many examples we have observed 
both methods to yield very similar results. 



We have computed the estimated error norm and the actual 
approximation error for both types: 



v^lOO 

2^7 = 11 a 3 

||L-L 10 || 

N^lOO 

=21 <7 J 

P 

to 

o 

I 

4.66e — 06 

9.30e - 06 

2.00e - 09 

9.65e - 09 

II 

1.75e - 05 

4.83e - 06 

1.72e - 08 

9.70e - 09 


As we can see, the upper error bound fails for type I, but is 
correct for type II. Nevertheless, judging from the H°° error, 
neither of the types seems to be preferable over the other. 


D. Summary 

Clearly, higher dimensional examples are required to get 
more insight. To this end a more sophisticated method for the 
solution of ( [30] ) is needed. With general purpose LMI-software 
on a standard Laptop, we hardly got higher than n = 100. 


IV. Conclusions 


We have compared two types of balanced truncation for 
stochastic linear systems, which are related to different 
Gramian type matrices P and Q. The following table collects 
properties of these reduction methods. 


Type 

I 

II 

Def. of P, Q 

(6| 

(7) 

Stability? 

Yes, (24] 

Yes, Thm. 

II.2 

i7 2 -bound? 

Yes' 1201 

no result 

H°°- bound? 

No, Ex. 1.3 

Yes, Thm. II.4 

or JH 


The main contributions of this paper are the preservation of 
asymptotic stability for type II balanced truncation proved 
in Theorem |IL2I and the new proof of the H°° error bound 
in Theorem II.4 The efficient solution of © is an open 
issue and requires further research. The same is true for the 
computation of the stochastic fT°°-norm. 


Appendix 

Asymptotic mean square stability 
Consider the stochastic linear system of Ito-type 

dx = Axdt + Nxdw , (31) 

where w = (w(t))te r + is a zero mean real Wiener process 
on a probability space (f2, P, p) with respect to an increasing 
family (P t )tem + of cr-algebras P t C P (e.g. (25), {26]). 

Let L 2 (R + ,R«) denote the corresponding space of non-anti¬ 
cipating stochastic processes v with values in W 1 and norm 

IIOIIlj, : = £ IKOII 2 ^) < °°> 

where £ denotes expectation. By definition, system © is 
asymptotically mean-square-stable, if £(||a;(t)|| 2 ) 0, for 

all initial conditions x(0) = Xo- 

We have the following version of Lyapunov’s matrix theo¬ 
rem, see ]23l . Here ® denotes the Kronecker product. 

Theorem A.l The following are equivalent. 

(i) System ( |3 1 1 ) is asymptotically mean-square stable. 

(ii) max{3f? ApA € a(A ® I + I <8 A + N 0 N)} <0 

(iii) 3Y > 0 : 3X > 0: A T X + XA + N T XN = —Y 

(iv) VF > 0 : 3X > 0: A T X + XA + N T XN = -Y 

(v) VF > 0 : 3A' > 0: A T X + XA + N T XN = -F 
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Remark A.2 The theorem (like all other results in this paper) 
carries over to systems 

k 

dx = Ax dt + NjX dwj 

i=i 

with more than one noise term, and many more equivalent 
criteria can be provided, see e.g. |[33l or |18j Theorem 3.6.1]. 

The following theorem does not require any stability as¬ 
sumptions (see lfl8l Theorem 3.2.3]). It is central in the 
analysis of mean-square stability. 

Theorem A.3 Let 

a = max{3?A | A £ a{A g) I + I (g) A + N ® N)} . 

Then there exists a nonnegative definite matrix V ^ 0, such 
that 

{. C* A + n^)(V) = AV + VA T + NVN t = aV . 

We also note a simple consequence of this theorem ll24l 
Corollary 3.2]. Here (Y, V) = trace(YV) is the Frobenius 
inner product for symmetric matrices. 

Corollary A.4 Let a, V as in the theorem. For given Y > 0 
assume that 

3X > 0 : C A (X) + H N (X) < —Y . (32) 

Then a < 0. Moreover, if a = 0 then YV = VY = 0. 

The stochastic bounded real lemma 

Now let us consider system ([5]) with input u and output y. 
If system ( |3T| is asymptotically mean-square stable, then ([5]) 
defines an input output operator L : u Kf y from L^(R, R m ) to 
L 2 w (R,W), see Q3. By ||L|| we denote the induced operator 
norm, which is an analogue of the deterministic H 00 -norm. It 
can be characterized by the stochastic bounded real lemma. 

Theorem A.5 fTTH For 7 > 0, the following are equivalent. 

(i) System © is asymptotically mean-square stable and 

INI <7- 

(ii) There exists a negative definite solution X < 0 to the 
Riccati inequality 

A t X + XA + N t XN - C T C - 'y~ 2 XBB T X > 0 . 

(iii) There exists a positive definite solution X > 0 to the 
Riccati inequality 

A t X + XA + N t XN + C T C + 7 ~ 2 XBB t X < 0 . 

We have stated the obviously equivalent formulations (ii) and 
(iii) to avoid confusion arising from different formulations 
in the literature. Under additional assumptions also non-strict 
versions can be formulated. The following sufficient criterion 
is given in in Corollary 2.2.3] (where also the signs are 
changed). Unlike in the previous theorem, here asymptotic 
mean-square stability is assumed at the outset. 


Theorem A.6 Assume that © is asymptotically stable in 

mean-square. If there exists a nonnegative definite matrix 

X > 0 , satisfying 

A t X + XA + N t XN + C T C + 7 ~ 2 XBB t X < 0 , 
then ||L|| < 7. 
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